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Reward  collected  by  performing  each  task 


Problem  Formulation  (cont’d) 
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Roll-out  Algorithm 


Variation:  At  each  iteration  use  \N  partial  solutions  to  extend 


Roll-out  approach:  a  single  iteration 
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M  extensions  M  extensions 


Roll-out  approach:  Limited  Tree  Search 


Numbers  inside  the  circles  indicate  the  order,  in  which  the  corresponding  nodes  are  generated 


Roll-out  algorithm  application  to  routing 

co-operating  vehicles 
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Base  heuristic: 

-  Select  an  available  task  to  maximize  reward  per  travel  time 


Experimental  results: 
evaluation  depth,  D 


rollout  evaluation  depth 


Experimental  results: 
search  width,  W 


Based  on  10  samples 


Experimental  results: 
number  of  candidate  extensions,  M 
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